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Overview: 

Research  under  the  above  grant  deals  with  the  general  area  of  reliability  theory  and  quality 
control.  An  emphasis  here  is  on  problems  emanating  from  the  area  of  software  engineering,  especially 
software  reliability  and  software  testing.  In  all  6  papers  have  been  published  or  accepted  for 
publication  in  the  open  literature,  and  2  are  currently  under  review.  In  the  latter  category,  one  of  the 
papers  deals  with  the  topic  of  warranties^  an  issue  w^hich  is  relatively  less  formally  researched  but  which 
appears  to  be  growing  in  importance  with  respect  to  both  military  and  commercial  systems  (to  include 
both  hardware  and  software). 


1.  Software  Certification  and  Reliability  Growth. 


In  the  general  area  of  software  reliability  2  papers  (see  references  2  and  5)  have  been  written, 
one  of  which  has  appeared  in  print  and  the  other  accepted  for  publication.  The  first  one  deals  with  the 
important  problem  of  how  much  testing  needs  to  be  done  to  a  piece  of  softw^are  before  it  is  released  for 
use.  The  problem  is  formulated  as  one  involving  decision  under  uncertainty  and  a  mathematical 


expression  for  obtaining  the  optimum  test  time  has  been  developed.  The  approach  has  been  codified 
for  use  on  a  personal  computer  and  this  software  is  included  in  a  package  of  programs  for  reliability 
analysis  that  is  currently  being  developed.  A  use  of  this  approach  calls  for  a  specification  of  the  costs 
of  testing  and  the  costs  of  failure  during  operation.  Unfortunately,  only  the  case  of  single  stage  testing 
has  been  rigorously  addressed.  The  more  realistic  case  of  sequential  testing  poses  horrendous  technical 


difficulties  and  remains  to  be  addressed.  Work  on  this  topic  continues. 
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The  second  paper  deals  with  the  topic  of  monitoring  the  growth  in  reliability  of  a  system,  say  a 
piece  of  software.  A  new  model  for  reliability  growth  is  proposed;  this  is  based  on  the  -power  law 
relationship,  and  a  Bayesian  approach  for  inference  about  the  model  parameters  and  tracking  the 
future  failure  times  is  developed.  The  model  reduces  to  a  nonhomogeneous  autoregressive  process 
which  under  certain  circumstances  can  be  addressed  via  a  Kalman  Filter  algorithm,  and  which  under 
other  circumstances  can  be  addressed  via  an  adaptive  Kalman  Filter  algorithm,  for  which  a  new 
solution  is  proposed.  The  solution  of  the  latter  involves  an  approximation  due  to  Lindley.  Thus  this 
work  makes  a  contribution  to  3  topics,  software  reliability  growth  (the  approach  is  illustrated  via  data 
on  software  testing),  time  series  analysis,  and  adaptive  Kalman  Filtering. 

It  is  anticipated  that  the  proposed  model  and  ensuing  approach  will  also  be  useful  for  the 
optimum  testing  of  software,  but  this  remains  to  be  explored. 

2.  Adversarial  Life  Testing  and  Acceptance  Sampling 

Military  standards,  for  quality  control  and  reliability,  such  as  MIL-STD>1051  and  MIL-STD- 
781C,  are  routinely  used  by  government  (particularly  the  DOD)  and  by  industry.  These  have  been 
severely  criticized  in  the  literature  on  grounds  of  uncoherence;  see  for  example  the  writings  of  Deming. 
A  Bayesian  approach  to  the  above  would  rectify  the  above  concern,  but  the  choice  of  a  prior  which  is 
acceptance  to  both  the  producer  and  the  consumer  has  been  an  obstacle.  As  a  way  of  obviating  this 
difficulty  a  new  approach  to  the  above  plans  has  been  proposed  and  developed  under  the  aegis  of  this 
grant;  see  references  4  and  7.  The  approach  allows  the  consumer  and  the  producer  to  assume  their 
own,  possibly  different,  priors  and  develops  suitable  formulae  for  the  accept /reject  regions  and  the 
necessary  sample  sizes.  The  word  adversarial  is  used  to  indicate  the  fact  that  the  producer  and  the 
consumer  are  adversaries,  and  each  is  trying  to  maximize  the  underlying  expected  utilities.  It  is  hoped 
that  the  above  development  will  be  picked  up  by  the  DOD  (which  is  the  caretaker  of  the  MIL  STD 


2 


plans)  and  implemented  for  use. 


3.  Accelerated  Life  Testing 

Accelerated  life  testing  is  routinely  done  in  reliability  assessment.  The  existing  procedures  for 
inference  from  accelerated  tests  are  predominantly  non-Bayesian;  their  disadvantage  has  been  an 
inability  to  incorporate  engineering  judgment  into  the  analysis  of  data  from  accelerated  tests.  The  use 
of  such  judgments  is  the  operating  norm  in  practical  applications  of  accelerated  tests.  Viewing  an 
accelerated  test  as  an  operation  in  filtering,  with  suitable  priors  to  reflect  engineering  judgment  offers 
hope,  and  a  proposal  to  do  the  above  was  advocated  by  the  PI,  An  implementation  of  this  approach  to 
some  real  live  data  from  a  biological  context  was  undertaken  under  the  aegis  of  this  grant;  see  reference 

3.  The  aim  here  was  to  demonstrate  the  feasibility  of  the  proposed  approach  and  to  describe  the 
practical  nuances  that  occur  when  one  attempts  to  undertake  it. 

4.  Dependence  in  Reliability 

The  notion  of  dependence  is  central  to  the  current  research  in  reliability  theory;  the  usual 
assumption  of  independence  has  resulted  in  unsatisfactory  assessments.  The  fact  that  dependence  is  a 
conditional  notion  has  not  been  explicated  in  the  literature  in  reliability.  Under  the  aegis  of  this  grant 
(see  reference  1),  such  conditioning  is  emphasized  and  the  idea  is  further  explored  by  making  the 
conditioning  parameter  random.  This  work  is  of  a  foundational  nature. 

5.  Warranties 

Whereas  consumers  are  used  to  acquiring  products  that  are  warranted  by  the  manufacturer, 
the  government,  particularly  DOD,  may  soon  be  moving  more  aggressively  in  that  direction.  It  is  vcrv 
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likely  that  warranties  may  be  mandated  in  the  future  procurement  activities  of  the  DOD.  The  problem 
of  optimum  warranties  is  a  multi-disciplinary  one,  which  involves  among  other  things,  issue  of 
reliability  and  renewal  theory.  Under  the  aegis  of  this  grant  the  problem  of  warranties  has  been  scoped 
out  (see  references  6  and  8)  and  specific  issues  germane  to  the  problem  addressed.  Of  particular 
interest  is  the  need  to  develop  a  new  class  of  failure  models  that  are  indexed  by  two  scales,  time  and 
usage.  Work  in  this  area  is  currently  in  progress.  The  topic  of  warranties  promises  to  become  a  full- 
fledged  multidisciplinary  research  area  in  the  mathematical  sciences. 


References 


Papers 

1.  Brady,  B.  and  Singpurwalla,  N.  D.  (1991).  Stochastically  Monotone  Dependence.  In  To'pics  in 
Siaiisiical  Dependence.  The  Institute  of  Mathematical  Statistics,  Lecture  Notes/Monograph  Series 
(Block,  H.  W.,  Sampson,  A.  R.,  and  Savits,  T.  H.,  Eds.),  pp.  93-102. 

2.  Singpurwalla,  N.  D.  (1991).  Determining  an  Optimal  Time  Interval  for  Testing  and  Debugging 
Software.  IEEE  Transactions  on  Software  Engineering^  VoL  i7,  No.  pp.  313-319. 

3.  Singpurwalla,  N.  D.  and  Chen,  J.  (1991).  Filtering,  Smoothing,  and  Extrapolations  in  Dose- 

Response  Experiments  with  Application  to  Data  on  Respiratory  Tumors  of  Rats.  In  Bayesian 
Inference  in  Statistics  and  Econometrics:  Proceedings  of  the  Indo-U.S.  Workshop,  1988.  New 
York;  Springer- Verlag.  To  appear.  ~ 

4.  Bindley,  D.  V.  and  Singpurwalla,  N.  D.  (1991).  On  the  Amount  of  Evidence  Needed  to  Reach 
Agreement  Between  Adversaries.  To  appear  in  JASA;  December  1991. 

5.  Singpurwalla,  N.  D.  and  Soyer,  R.  (1992).  Nonhomogeneous  Autoregressive  Processes  for  Tracking 
Reliability  Growth,  and  Their  Bayesian  Analysis.  To  appear  in  JRSS(B),  Vol.  54,  No.  1,  1992. 

6.  Singpurwalla,  N.  D.  and  Wilson,  S.  (1992).  Warranties.  To  appear  in  Bayesian  Statistics  4. 

Edited  by  J.  Berger,  J.  Bernardo,  P.  Dawid  and  A.  Smith. 

Technical  Reix)rts 


7.  Bindley,  D.  V.  and  Singpurwalla,  N.  D.  (1991).  Adversarial  Life  Testing.  Technical  Report 
GWU/IRRA/Serial  TR-90/5.  The  George  Washington  University,  Washington,  DC.  Under 
Review. 

8.  Singpurwalla,  N.  D.  and  Wilson,  S.  (1991).  The  Warranty  Problem:  Its  Statistical  and  Game 
Theoretic  Aspects.  Technical  Report  GWU/IRRA/Serial  TR-91/1.  The  George  Washington 
University,  Washington,  DC.  Under  Review. 


4 


FINAL  TECHNICAL  REPORT  , 

(Air  Force  Office  of  Scientific  Research  AFOSR-F-49620-92-J-0030) 


Under  the  aegis  of  the  above  grant,  the  following  technical  reports  have  been  written.  The 
citations  of  published  papers  are  also  shown. 


Publications  in  Refereed  Journals 


[1]  Abel,  P.  S.  and  N.  D.  Singpurwalla  (1994).  To  survive  or  to  fail:  That  is  the  question.  The 

American  Staiijiician  48:  18-21. 

[2]  Campodonico,  S.  and  N.  D.  Singpurwalla  (1994).  The  signature  as  a  covariate  in  reUabUity  and 

biometry.  In  Aspecta^af  Uncertainty  eds.'  P.  R.  Freeman  and  A.F.M.  Smith,  119-147.  New 
York,  NY:  John  Wiley. 

[3]  Campodonico,  S.  and  N — D.,  .Singpurwalla .  (1994).  A  Bayesian  analysis  of  the  logarithmic- 

poisson  execution  time  model  based  on  expert  opinion  and  failure  data.  IEEE  Transactions 
on  Sofixeare  Engineering  20:^'  677-683. 

[4]  Chen,  J.  and  N.  D.  Singpurwalla  (1994).  Control  theory  methods  in  product  quality  assurance: 

An  illustration  of  open  loop  control.  Journal  of  Applied  Statistical  Science  1:  263-278. 

[5]  Chen,  Y.  and  N.  D.  Singpurwalla  (1994).  A  non-Gaussian  kalman  filter  model  for  tracking 

software  reliability.  Siatisiica  Sinica  4:  535-548. 

[6]  Lindley,  D.  V.  and  N.  D.  Singpurwalla  (1993).  Adversarial  life  testing.  Journal  of  the  Royal 

Statistical  Society  B  55:  837-847. 

[7]  Singpurwalla,  N.  D.  and  R.  L.  Smith  (1992).  A  conversation  with  Boris  Vladimirovich 

Gnedenko.  5tatt5<ica/  Science  7  (2):  273-283. 

[8]  Singpurwalla,  N.  D.  and  S.  P.  Wilson  (1992-1993).  Models  for  assessing  the  'reliability  of 

computer  software.  Naval  Research  Reviews  4/92-1/93:  21-9. 

[9]  Singpurwalla,  N.  D.  and  M.  A.  Youngren  (1993).  Multivariate  distributions  induced  by 

dynamic  environments.  Scandinavian  Journal  of  Statistics  20:  251-261. 

[10]  Singpurwalla,  N.  D.  and  S.  P.  Wilson  (1994).  Software  reUability  modeling.  International 

Statistical  Review  62:  289-317. 

Publications  to  Appear 

[1]  Singpurwalla,  N.  D.  The  failure  rate  of  software:  Does  it  exist? 

[2]  Singpurwalla,  N.  D.  Entropy  and  information  in  reliability. 

[3]  Singpurwalla  N.  D.,  S.  P.  Wilson  and  E.  R.  Fuller,  Jr.  SUtistical  Aspects  of  Failure  Processes 

in  Ceramics. 


Technical  Rcporta  lagged 


[1]  Abel,  P.  S.  and  N.  D,  Singpuralla  (1992).  To  survive  or  to  fail:  That  is  the  question. 

Technical  Report  GVVU/lRRA/92/12.  Washington,  DC:  George  Washington  University, 
Institute  for  Reliability  and  Risk  Analysis. 


[2]  Campodonico,  S.  and  N.  D.  Singpurwalla  (1992).  Expert  opinion  in  reliability.  Technical 
Report  GWU/IRRA/92/5.  Washington,  DC:  GWU,  IRRA. 


[3]  Campodonico,  S.  and  N.  D.  Singpurwalla  (1992).  A  Bayesian  analysis  of  the  logarithmic- 
poisson  execution  time  model  based  on  expert  opinion  and  failure  data.  Technical  Report 
GWU/IRRA/92/22.  Washington,  DC:  GWU,  IRRA. 


[4]  Campodonico,  S.  and  N.  D,  Singpurwalla  (1993).  Inference  and  predictions  from  poisson  point 
processes  incorporating  expert  knowledge.  Technical  Report  GWU/IRRA/93/1.  Washington, 
DC:  GWU,  IRRA. 


Campodonico,  S.  and  N.  D.  Singpurwalla  (1993).  The  signature  as  a  covariate  in  reliability  and 
"  biometry^r^echnic^~R%k>r1;~<3WU/IRRA/93/4.  Washington,  DC:  GWU,  IRRA. 


[6]  Chen,  J.  and  N.  D.  Singpurwalla  (1994).  The  notion  of  composite  reliability  and  its  hierarchical 
Bayes  estimation.  Technical-Report  GWU/IRRA/94/2.  Washington,  DC:  GWU,  IRRA. 


[7]  Chen,  Y.  and  N.  D.  Singpurwalla  (1993).  A  non-Gaussian  kalman  filter  model  for  tracking 

software  reliability.  Technical  Report  GWU/IRRA/93/2.  Washington,  DC:  GWU,  IRRA. 

[8]  Singpurwalla,  N.  D.  (1991).  An  eavesdrop  on  a  chance  encounter  of  like-minded  ghosts. 

Technical  Report  GWU/IRRA/91/14.  Washington,  DC:  GWU,  IRR4. 

[9]  Singpurwalla,  N.  D.  (1992).  Survival  in  dynamic  environments.  Technical  Report 

GWU/IRRA/92/1.  Washington,  DC:  GWU,  IRRA. 

[10]  Singpurwalla,  N.  D.  (1992).  A  review  of  Crowder  et  al’s  statistical  analysis  of  reliability  data. 

Technical  Report  GWU^RRA/92/14.  Washington,  DC:  GWU,  IRRA. 


[11]  Singpurwalla,  N.  S.  (1992).  The  failure  rate  of  software:  Does  it  exist?  Technical  Report 

GWU/IRRA/92/15.  Washington,  DC:  GWU,  IRRA. 

[12]  Singpurwalla,  N.  D.  (1992).  Entropy  and  information  in  reliability.  Technical  Report 

GWU/IRRA/92/16.  Washington,  DC:  GWU,  IRRA. 

[13]  Singpurwalla,  N.  D.  and  S.  P.  Wilson  (1991).  Models  for  assessing  the  reliability  of  computer 

software.  Technical  Report  GWU/IRRA/9 1/13.  Washington,  DC:  GWU,  IRRA. 

[14]  Singpurwalla,  N.  D.  and  S.  P.  Wilson  (1993).  Softare  reliability  modeling.  Technical  Report 

GWU/IRRA/93/3.  Washington,  DC:  GWU,  IRRA. 

[15]  Singpurwalla,  N.  D.,  S.  P.  Wilson  and  E.  R.  Fuller,  Jr.  (1994).  Statistical  aspects  of  failure 

processes  in  Ceramics.  Technical  Report  GWU/IRRA/94/3.  Washington,  DC:  GWU, 
IRRA. 


